Method and apparatus for variable impedence touch sensor array force aware interaction in large surface devices

ABSTRACT

The present invention relates to interpolated variable impedance touch sensor arrays for force-aware large-surface device interaction. An exemplary system for detecting a continuous pressure curve includes a plurality of physical variable impedance array (VIA) columns connected by interlinked impedance columns and a plurality of physical VIA rows connected by interlinked impedance rows. The system also includes a plurality of column drive sources connected to the interlinked impedance columns and to the plurality of physical VIA columns through the interlinked impedance columns as well as a plurality of row sense sinks connected to the interlinked impedance rows and to the plurality of physical VIA rows through the interlinked impedance rows. Further, the system includes a processor configured to interpolate the continuous pressure curve in the physical VIA columns and physical VIA rows from an electrical signal from the plurality of column drive sources sensed at the plurality of row sense sinks.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims priority to U.S. Provisional Patent ApplicationNo. 62/730,752 titled METHOD AND APPARATUS FOR VARIABLE IMPEDANCE TOUCHSENSOR ARRAY FORCE AWARE INTERACTION IN LARGE SURFACE DEVICES and filedon Sep. 13, 2018, the disclosure of which is hereby incorporated hereinby reference in its entirety.

INTRODUCTION

The present invention relates to touch sensor detector systems andmethods incorporating an interpolated variable impedance touch sensorarray and specifically to such systems and methods for force-awareinteraction with large surface devices. The systems and methodsdisclosed herein utilize a touch sensor array configured to detectproximity/contact/pressure via a variable impedance array electricallycoupling interlinked impedance columns coupled to an array column driverand interlinked impedance rows coupled to an array row sensor. The arraycolumn driver is configured to select the interlinked impedance columnsbased on a column switching register and electrically drive theinterlinked impedance columns using a column driving source. Thevariable impedance array conveys current from the driven interlinkedimpedance columns to the interlinked impedance columns sensed by thearray row sensor. The array row sensor selects the interlinked impedancerows within the touch sensor array and electrically senses theinterlinked impedance rows state based on a row switching register.Interpolation of array row sensor sensed current/voltage allows accuratedetection of touch sensor array proximity/contact/pressure and/orspatial location.

The gesture recognition systems and methods using variable impedancearray sensors include sensors disclosed in the following applications,the disclosures of which are hereby incorporated by reference in theirentirety: U.S. patent application Ser. No. 15/599,365 titled SYSTEM FORDETECTING AND CONFIRMING A TOUCH INPUT filed on May 18, 2017; U.S.patent application Ser. No. 15/653,856 titled TOUCH SENSOR DETECTORSYSTEM AND METHOD filed on Jul. 19, 2017; U.S. patent application Ser.No. 15/271,953 titled DIAMOND PATTERNED TOUCH SENSOR SYSTEM AND METHODfiled on Sep. 21, 2016; U.S. patent application Ser. No. 14/499,090titled CAPACITIVE TOUCH SENSOR SYSTEM AND METHOD filed on Sep. 27, 2014and issued as U.S. Pat. No. 9,459,746 on Oct. 4, 2016; U.S. patentapplication Ser. No. 14/499,001 titled RESISTIVE TOUCH SENSOR SYSTEM ANDMETHOD filed on Sep. 26, 2014 and issued as U.S. Pat. No. 9,465,477 onOct. 11, 2016; U.S. patent application Ser. No. 15/224,003 titledSYSTEMS AND METHODS FOR MANIPULATING A VIRTUAL ENVIRONMENT filed on Jul.29, 2016 and issued as U.S. Pat. No. 9,864,461 on Jan. 9, 2018; U.S.patent application Ser. No. 15/223,968 titled SYSTEMS AND METHODS FORMANIPULATING A VIRTUAL ENVIRONMENT filed on Jul. 29, 2016 and issued asU.S. Pat. No. 9,864,460 on Jan. 9, 2018; U.S. patent application Ser.No. 15/470,669 titled SYSTEM AND METHOD FOR DETECTING AND CHARACTERIZINGFORCE INPUTS ON A SURFACE filed on Mar. 27, 2017; and U.S. patentapplication Ser. No. 15/476,732 titled HUMAN-COMPUTER INTERFACE SYSTEMfiled on Oct. 5, 2017.

BRIEF DESCRIPTION OF THE DRAWINGS

The aforementioned objects and advantages of the present invention, aswell as additional objects and advantages thereof, will be more fullyunderstood herein after as a result of a detailed description of apreferred embodiment when taken in conjunction with the followingdrawings in which:

FIG. 1 illustrates a system using an exemplary interpolated variableimpedance sensor array for gesture recognition.

FIG. 2 illustrates a system using an exemplary interpolated variableimpedance sensor array for gesture recognition.

FIG. 3 illustrates a system using an exemplary interpolated variableimpedance sensor array for gesture recognition.

FIG. 4 illustrates a system using an exemplary interpolated variableimpedance sensor array for gesture recognition.

FIG. 5 illustrates an exemplary variable impedance touch sensor arraywith interlinked impedance columns and interlinked impedance rows.

FIG. 6 illustrates an exemplary column switching register, row switchingregister, interlinked impedance column, and interlinked impedance row ofan exemplary variable impedance touch sensor array.

FIG. 7 illustrates an exemplary variable impedance touch sensor array.

FIG. 8 shows exemplary pressure response curves for point sets insystems using exemplary interpolated variable impedance sensor arraysfor gesture recognition.

FIG. 9 shows exemplary pressure response curves for point sets insystems using exemplary interpolated variable impedance sensor arraysfor gesture recognition.

FIG. 10 illustrates a system using an exemplary interpolated variableimpedance sensor array for gesture recognition.

FIG. 11 illustrates examples of touch patterns for systems usingexemplary interpolated variable impedance sensor arrays for gesturerecognition.

FIG. 12 shows exemplary pressure response curves for point sets insystems using exemplary interpolated variable impedance sensor arraysfor gesture recognition.

FIG. 13 illustrates a system using an exemplary interpolated variableimpedance sensor array for gesture recognition.

FIG. 14 illustrates a system using an exemplary interpolated variableimpedance sensor array for gesture recognition.

FIG. 15 illustrates a system using an exemplary interpolated variableimpedance sensor array for gesture recognition.

FIG. 16 illustrates a system using an exemplary interpolated variableimpedance sensor array for gesture recognition.

FIG. 17 illustrates a system using an exemplary interpolated variableimpedance sensor array for gesture recognition.

FIG. 18 illustrates a system using an exemplary interpolated variableimpedance sensor array for gesture recognition.

FIG. 19a illustrates a system using an exemplary interpolated variableimpedance sensor array for gesture recognition.

FIG. 19b illustrates a system using an exemplary interpolated variableimpedance sensor array for gesture recognition.

FIG. 20 illustrates visual feedback possible with an exemplary variableimpedance touch sensor array system and continuous response and userfeedback and discontinuous response and user feedback.

FIG. 21 illustrates visual feedback possible with an exemplary variableimpedance touch sensor array system and continuous response and userfeedback and discontinuous response and user feedback.

FIG. 22 illustrates an exemplary method of using an interpolatedvariable impedance sensor array for gesture recognition

DETAILED DESCRIPTION

The present invention relates to touch sensor detector systems andmethods incorporating an interpolated variable impedance touch sensorarray and specifically to such systems and methods for force-awareinteraction with large surface devices such as desktop displays, laptopdisplays, laptop interface surfaces (e.g., C-top touch interfaces),tabletop touch interfaces, large trackpads, countertop touch interfaces,virtual reality displays, augmented reality displays, flexiblesubstrates and wall mounted touch and/or interfaces. The systems andmethods disclosed herein utilize a touch sensor array configured todetect proximity/contact/pressure via a variable impedance arrayelectrically coupling interlinked impedance columns coupled to an arraycolumn driver and interlinked impedance rows coupled to an array rowsensor. The array column driver is configured to select the interlinkedimpedance columns based on a column switching register and electricallydrive the interlinked impedance columns using a column driving source.The variable impedance array conveys current from the driven interlinkedimpedance columns to the interlinked impedance columns sensed by thearray row sensor. The array row sensor selects the interlinked impedancerows within the touch sensor array and electrically senses theinterlinked impedance rows state based on a row switching register.Interpolation of array row sensor sensed current/voltage allows accuratedetection of touch sensor array proximity/contact/pressure and/orspatial location.

In one embodiment, the system for detecting a continuous pressure curvefor a touch on a display device includes a plurality of physicalvariable impedance array (VIA) columns connected by interlinkedimpedance columns and a plurality of physical VIA rows connected byinterlinked impedance rows. Additionally, the system includes aplurality of column drive sources connected to the interlinked impedancecolumns and to the plurality of physical VIA columns through theinterlinked impedance columns and a plurality of row sense sinksconnected to the interlinked impedance rows and to the plurality ofphysical VIA rows through the interlinked impedance rows. Further, thesystem includes a processor configured to interpolate the continuouspressure curve in the physical VIA columns and physical VIA rows from anelectrical signal from the plurality of column drive sources sensed atthe plurality of row sense sinks.

The processor may also be configured to detect two or more touches at afirst time, determine that the two or more touches at the first time arearranged in a pattern corresponding to a predetermined gesture,determine a relative pressure between the two or more touches from theelectrical signal from the plurality of column drive sources sensed atthe plurality of row sense sinks, and associate the continuous pressurecurve with a user interface (UI) element, the UI element accepting anadjustment input based on the relative pressure between the two or moretouches, and provide a confirming input to the UI element based on therelative pressure between the two or more touches.

In another embodiment, the system for detecting a continuous pressurecurve for a touch on a display device includes a VIA, an array columndriver, an array row sensor, and a processor. The VIA includesinterlinked impedance columns coupled to the array column driver andinterlinked impedance rows coupled to the array row sensor. And thearray column driver is configured to select the interlinked impedancecolumns based on a column switching register and electrically drive theinterlinked impedance columns using a column driving source. Also, theVIA conveys current from the driven interlinked impedance columns to theinterlinked impedance columns which are sensed by the array row sensor,and the array row sensor selects the interlinked impedance rows andelectrically senses a state of the interlinked impedance rows based on arow switching register. Further, the processor interpolates a locationof the touch from the state of the interlinked impedance rows sensed byarray row sensor.

An exemplary method for receiving a gesture formed on or about two ormore sensor panels on a plurality of faces of a device includesdetecting two or more touches at a first time at the sensor panels;determining that the two or more touches at the first time are arrangedin a pattern corresponding to a predetermined gesture, determining arelative pressure between the two or more touches, associating thegesture with a user interface (UI) element, the UI element accepting anadjustment input based on the relative pressure between the two or moretouches, and providing the confirming input to the UI element based onthe relative pressure between the two or more touches.

An exemplary variable impedance touch sensor array includes interlinkedimpedance columns and interlinked impedance rows as well as an exemplarycolumn switching register, row switching register, interlinked impedancecolumn, and interlinked impedance row. A variable impedance arrayincludes columns and rows of an array in which individual variableimpedance array elements may interconnect within the row/column crosspoints of the array. These individual variable impedance array elementsmay comprise active and/or passive components based on the applicationcontext, and include any combination of resistive, capacitive, andinductive components.

The physical variable impedance array columns and variable impedancearray rows are connected via interlinked impedance columns andinterlinked impedance rows, respectively. The interlinked impedancecolumns and interlinked impedance rows are configured to reduce thenumber of columns and rows that are connected to the column drivesources and the row sense sinks. As such, the combination of theinterlinked impedance columns and interlinked impedance rows will reducethe external components necessary to interface to the variable impedancearray columns and variable impedance array rows. Within the context ofthe present invention, the number of interlinked impedance columnsinterconnects will be configured to allow the reduction of the number ofcolumn drive sources to less than the number of physical variableimpedance array columns (thus the number of external interlinkedimpedance columns is typically less than the number of internalinterlinked impedance columns columns), and the interlinked impedancerows interconnects will be configured to allow the reduction of thenumber of row sense sinks to less than the number of physical variableimpedance array rows (thus the number of external interlinked impedancerows is typically less than the number of interlinked impedance rowsrows). This reduction is achieved by having one or more interlinkedimpedance columns elements in series between each variable impedancearray physical column and one or more interlinked impedance rowselements between each variable impedance array physical row.

Note that within the context of these preferred embodiments, there maybe circumstances where the interlinked impedance columns may incorporatea plurality of interlinked impedances with the interlinked impedancerows incorporating a singular interlinked impedance element, andcircumstances where the interlinked impedance columns may incorporate asingular interlinked impedance element with the interlinked impedancerows incorporating a plurality of interlinked impedance elements.

The interlinked impedance columns impedance elements are configured toconnect individual variable impedance array columns. These interlinkedimpedance columns impedance elements may comprise active and/or passivecomponents based on the application context and include any combinationof resistive, capacitive, and inductive components. The interlinkedimpedance rows impedance elements are configured to connect individualvariable impedance array rows. These interlinked impedance rowsimpedance elements may comprise active and/or passive components basedon the application context and include any combination of resistive,capacitive, and inductive components.

The interlinked impedance columns and interlinked impedance rowsimpedance networks may comprise a wide variety of impedances that may bestatic or actively engaged by the configuration of the column switchingregister and row switching register, respectively. Thus, the columnswitching register and row switching register may be configured in somepreferred embodiments to not only stimulate/sense the variable impedancearray behavior, but also internally configure the interlinked nature ofthe variable impedance array by reconfiguring the internal columncross-links and the internal row cross-links. All this behavior can bedetermined dynamically by control logic that may include amicrocontroller or other computing device executing machine instructionsread from a computer-readable medium. Within this context, the behaviorof the analog-to-digital (ADC) converter may be controlled in part bythe configuration of the column switching register and/or row switchingregister, as well as the control logic. For example, based on theconfiguration of the column switching register and row switchingregister, the ADC may be configured for specific modes of operation thatare compatible with the type of sensing associated with the columnswitching register/row switching register setup.

FIG. 1 illustrates a system 100 using an exemplary interpolated variableimpedance sensor array for gesture recognition. FIG. 4 shows a touchinterface 110 using the exemplary interpolated variable impedance sensorarray. The touch interface 110 could be a touchscreen or trackpad or thelike and could be integral, attached, or detached from a computer orcomputing device with a UI. In one embodiment, a processorcommunicatively coupled to the sensor array 110 is programmed to receivea gesture input formed on or about the face of the sensor array 110. Theprocessor may be programmed to detect two or more touches on the sensorarray 110. Two exemplary touches 120, 121 are illustrated as circles inFIG. 1. The circles 120, 121 represent points at which a user hascontacted the sensor array 110. In one embodiment, the processor isprogrammed to determine that the two or more touches are arranged in apattern corresponding to a predetermined pattern. For example, theprocessor may determine the distance (D) between the two points 120,121. Whether the distance (D) is greater than or less than somethreshold may be used to determine if the touch points 120, 121correspond to a given pattern. For example, as shown in FIG. 2, the twopoints 220, 221 may be required to be less than a threshold distancethat is within the span of an index finger to a thumb as shown. Thisway, other types of touches could be rejected. In FIG. 2, the sensorarray 210 is only slightly larger than a hand. This would be typical ofa mobile device touchscreen or an inset touchpad.

Alternatively, as shown in FIG. 3, the two points 320, 321 may berequired to be greater than a threshold distance that is greater thanthe span between fingers and/or the thumb of one hand. This way, typesof touches from one hand could be rejected. In FIG. 3, the sensor array310 is multiple hand-spans in each direct. This would be typical of alarge touch interface such as large touchscreen monitor or tabletoptouch interface. Further, the processor may be programmed to look forspecific combinations of touch points within certain distances of eachother. For example, in FIG. 4, touches 420, 421, 422 correspond to athumb, index finger, and middle finger respectively. The processor maybe programmed to determine the relative distance between each of thetouches 420, 421, 422 and determine if the distance meets one or morethreshold criteria. This way, the processor may be programmed torecognize patterns created by various combinations of finger touches onthe sensor array 410.

FIGS. 5-7 illustrate an exemplary variable impedance touch sensor array500, 600, 700 including interlinked impedance columns and interlinkedimpedance rows as well as an exemplary column switching register, rowswitching register, interlinked impedance column, and interlinkedimpedance row. FIG. 5 illustrates an exemplary variable impedance array510, interlinked impedance columns 520, and interlinked impedance rows530. Here the variable impedance array 510 includes columns 512 and rows513 of an array in which individual variable impedance array elements519 may interconnect within the row/column cross points of the array.These individual variable impedance array elements 519 may compriseactive and/or passive components based on the application context, andinclude any combination of resistive, capacitive, and inductivecomponents. Thus, the variable impedance array 510 array impedanceelements are depicted generically in this diagram as generalizedimpedance values Z.

The physical variable impedance array columns 512 and variable impedancearray rows 513 are connected via interlinked impedance columns 520 andinterlinked impedance rows 530, respectively. The interlinked impedancecolumns 520 and interlinked impedance rows 530 are configured to reducethe number of columns and rows that are connected to the column drivesources 521, 523, 525 and the row sense sinks 531, 533, 535. As such,the combination of the interlinked impedance columns 520 and interlinkedimpedance rows 530 will reduce the external components necessary tointerface to the variable impedance array columns 512 and variableimpedance array rows 513. Within the context of the present invention,the number of interlinked impedance columns 520 interconnects will beconfigured to allow the reduction of the number of column drive sources521, 523, 525 to less than the number of physical variable impedancearray columns 512 (thus the number of external interlinked impedancecolumns is typically less than the number of internal interlinkedimpedance columns columns), and the interlinked impedance rows 530interconnects will be configured to allow the reduction of the number ofrow sense sinks 531, 533, 535 to less than the number of physicalvariable impedance array rows 513 (thus the number of externalinterlinked impedance rows is typically less than the number ofinterlinked impedance rows rows). This reduction is achieved by havingone or more interlinked impedance columns 520 elements 529 in seriesbetween each variable impedance array physical column 512 and one ormore interlinked impedance rows 530 elements 539 between each variableimpedance array physical row 513. Thus, the XXY variable impedance arraysensor 510 is translated to an electrical interface only requiring Pcolumn drivers and Q row sensors. The present invention constrains P≤Xand Q≤Y with many preferred embodiments satisfying the relations X/P≥2or Y/Q≥2.

Note that within the context of these preferred embodiments, there maybe circumstances where the interlinked impedance columns may incorporatea plurality of interlinked impedances with the interlinked impedancerows incorporating a singular interlinked impedance element, andcircumstances where the interlinked impedance columns may incorporate asingular interlinked impedance element with the interlinked impedancerows incorporating a plurality of interlinked impedance elements.

The interlinked impedance columns 520 impedance elements 529 areconfigured to connect individual variable impedance array columns 512.These interlinked impedance columns 520 impedance elements 529 maycomprise active and/or passive components based on the applicationcontext and include any combination of resistive, capacitive, andinductive components. Thus, the interlinked impedance columns 520impedance elements 529 are depicted generically in this diagram asgeneralized impedance values X. As depicted in the diagram, theindividual variable impedance array columns may either be directlydriven using individual column drive sources 521, 523, 525 orinterpolated 522, 524 between these directly driven columns.

The interlinked impedance rows 530 impedance elements 539 are configuredto connect individual variable impedance array rows 513. Theseinterlinked impedance rows 530 impedance elements 539 may compriseactive and/or passive components based on the application context andinclude any combination of resistive, capacitive, and inductivecomponents. Thus, the interlinked impedance rows 530 impedance elements539 are depicted generically in this diagram as generalized impedancevalues Y. As depicted in the diagram, the individual variable impedancearray rows may either be directly sensed using individual row sensesinks 531, 533, 535 or interpolated 532, 534 between these directlysensed rows.

The column drive sources 521, 523, 525 are generically illustrated asbeing independent in this diagram but may be combined in someconfigurations utilizing a series of switches controlled by a columnswitching register that defines the type of column drive source to beelectrically coupled to each column that is externally accessible to thevariable impedance array sensors 510. Variations of AC/DC excitation,voltage sources, open circuits, current sources, and other electricalsource driver combinations may be utilized as switched configurationsfor the column drive sources 521, 523, 525. The column switchingregister may be configured to both select the type of electrical sourceto be applied to the variable impedance array sensors 510 but also itsrelative amplitude/magnitude.

The row sense sinks 531, 533, 535 are generically illustrated as beingindependent in this diagram but may be combined in some configurationsutilizing a series of switches controlled by a row switching registerthat defines the type of row sense sinks to be electrically coupled toeach row that is externally accessible to the variable impedance arraysensors 510. Variations of AC/DC excitation, voltage sources, opencircuits, current sources, and other electrical sense sink combinationsmay be utilized as switched configurations for the row sense sinks 531,533, 535. The row switching register may be configured to both selectthe type of electrical sink to be applied to the variable impedancearray sensors 510, but also its relative amplitude/magnitude.

Further detail of the column switching register and row switchingregister column/row source/sink operation is depicted in FIG. 6 (600)wherein the variable impedance array 610 is interfaced via the use ofthe interlinked impedance columns 612 and interlinked impedance rows 613impedance networks to column drive sources 621, 623, 625 and row sensesinks 631, 633, 635, respectively. The column switching registers 620may comprise a set of latches or other memory elements to configureswitches controlling the type of source drive associated with eachcolumn drive source 621, 623, 625, the amplitude/magnitude of the drivesource, and whether the drive source is activated. Similarly, the rowswitching registers 630 may comprise a set of latches or other memoryelements to configure switches controlling the type of sense sinkassociated with each row sense sink 631, 633, 635, theamplitude/magnitude of the sink, and whether the sink is activated.

As mentioned previously, the interlinked impedance columns 612 andinterlinked impedance rows 613 impedance networks may comprise a widevariety of impedances that may be static or actively engaged by theconfiguration of the column switching register 620 and row switchingregister 630, respectively. Thus, the column switching register 620 androw switching register 630 may be configured in some preferredembodiments to not only stimulate/sense the variable impedance array 610behavior, but also internally configure the interlinked nature of thevariable impedance array 610 by reconfiguring the internal columncross-links and the internal row cross-links. All this behavior can bedetermined dynamically by control logic 640 that may include amicrocontroller or other computing device executing machine instructionsread from a computer-readable medium 644. Within this context, thebehavior of the analog-to-digital (ADC) converter 650 may be controlledin part by the configuration of the column switching register 620 and/orrow switching register 630, as well as the control logic 640. Forexample, based on the configuration of the column switching register 620and row switching register 630, the ADC 650 may be configured forspecific modes of operation that are compatible with the type of sensingassociated with the column switching register 620/row switching register630 setup.

FIG. 7 illustrates 700 an exemplary variable impedance array sensor 710in which the interlinked impedance columns 720 form a reduced electricalinterface to the physical variable impedance array sensor columns 712that comprise the variable impedance array sensor array 710. Similarly,the interlinked impedance rows 730 form a reduced electrical interfaceto the physical variable impedance array sensor rows 713 that comprisethe variable impedance array sensor array 710. Note in this example thatthe number of physical variable impedance array columns 712 need not bethe same as the number of physical variable impedance array rows 713.Furthermore, the number of column interpolation impedance components (X)serially connecting each column of the variable impedance array 710 neednot be equal to the number of row interpolation impedance components (Y)serially connecting each row of the variable impedance array 710. Inother words, the number of interpolated columns 722, 724 need not beequal to the number of interpolated rows 732, 734.

The control logic 740 provides information to control the state of thecolumn switches 721, 723, 725 and row switches 731, 733, 735. The columnswitches 721, 723, 725 define whether the individual variable impedancearray columns are grounded or driven to a voltage potential from avoltage source 727 that may in some embodiments be adjustable by thecontrol logic 740 to allow on-the-fly adjustment 741 which can be usedto compensate for potential non-linearities in the driving electronics.Similarly, the row switches 731, 733, 735 define whether an individualvariable impedance array row is grounded or electrically coupled to thesignal conditioner 760 and associated ADC 750.

In the configuration depicted in FIG. 7, the variable impedance arraysensors 710 comprise uniformly two interpolating impedances between eachcolumn (X) and three interpolating impedances between each row (Y). Thisillustrates the fact that the number of interpolating columns need notequal the number of interpolating rows in a given variable impedancearray. Furthermore, it should be noted that the number of interpolatingcolumns need not be uniform across the variable impedance array, nordoes the number of interpolating rows need be uniform across thevariable impedance array. Each of these parameters may vary in numberacross the variable impedance array.

Note also that the variable impedance array sensors 710 need not haveuniformity within the row or column interpolating impedances and thatthese impedances in some circumstances may be defined dynamically innumber and/or value using MOSFETs or other transconductors. In thisexemplary variable impedance array sensor segment, it can be seen thatone column 723 of the array is actively driven while the remaining twocolumns 721, 725 are held at ground potential. The rows are configuredsuch that one row 733 is being sensed by the signal conditioner 760/ADCcombination 750 while the remaining rows 731, 735 are held at groundpotential.

The processor is communicatively coupled to the sensor array shown inthe Figures and is programmed to receive pressure information from thesensor array. As described above and in the incorporated references, thesensor array is designed to provide a continuous pressure gradient witha high-density array. In the interpolated variable impedance sensorarray, interpolation blocks (interlinked impedance columns andinterlinked impedance rows) allow the variable impedance array sensorsto be scanned at a lower resolution. Because of the configuration of theinterlinked impedance columns and interlinked impedance rows, the sensorhardware can properly down sample the signal in the variable impedancearray (in a linear fashion). As a result, the scanned values in thelower-resolution array (touch sensor matrix) data structure) extractedfrom this variable impedance array sensor data resemble that of alinearly down sampled sensor response. This down sampling allowsreconstruction of the positions, force, shape, and other characteristicsof touches at the resolution of the variable impedance array (and evenpossibly at a higher resolution than the variable impedance array) insoftware.

As an example, on a variable impedance array sensor array constructedwith 177 column electrodes and 97 row electrodes having a 1.25 mm pitch,it could be possible in theory to build electronics with 177 columndrive lines and 97 row sense lines to support sensing of this entirevariable impedance array. However, this would be prohibitive in terms ofcost and it would be very difficult to route that many row and senselines on a conventional printed circuit board in a space efficientmanner. Additionally, this 177×97 variable impedance array sensorconfiguration would require scanning 177×97=17169 intersections, whichwith a low power microcontroller (such as an ARM M3) would result in amaximum scan rate of approximately 10 Hz (which is unacceptably slow fortypical user interaction with a touch screen). Finally, assuming 16-bitADC values, storage for these touch screen values would require17169×2=34 KB of memory for a single frame, an excessive memoryrequirement for small microcontrollers that may only be configured with32 KB of RAM. Thus, the use of conventional row/column touch sensortechnology in this context requires a much more powerful processor andmuch more RAM, which would make this solution too expensive and complexto be practical for a consumer electronics application.

Rather than scanning the exemplary sensor array described above at thefull 177×97 resolution, the system is configured to scan at a lowerresolution but retain the accuracy and quality of the signal as if ithad been scanned at 177×97. The drive electronics on a typical presentinvention embodiment for this sensor array would require only 45 columndrivers and 25 row drivers. The interpolation circuit allows the systemto scan the 177×97 array using only a complement of 45×25 electronics.This cuts the number of intersections that must be scanned down by afactor of 16 to 45×25=1125. This configuration allows scanning thesensor at 150 Hz and reduces memory consumption in a RAM-constrainedmicrocontroller application context. Although the ability to resolve twotouches that are 1.25 mm together (or to see exactly what is happeningat each individual sensor element) is lost, it is still possible totrack a touch at the full resolution of the variable impedance arraysensors because of the linearity of the row/column interpolationperformed by using the (interlinked impedance columns and interlinkedimpedance rows. In some embodiments the grid spacing is less than orequal to 5 mm.

The processor is programed to determine the relative pressure betweenthe two more touches on the sensor array and to associate the patternand pressure response with a gesture. The processor may provide input toa UI of an associated device based on the gesture, pattern, and/orpressure response.

In one embodiment, the processor is programmed to determine if a user isperforming a see-saw pattern on the sensor array by touching the arrayat two or more points and varying the pressure at the two or more pointsin a rocking manner, that is increasing the pressure at one point whilesimultaneously decreasing the pressure at another point. For example,FIG. 8 shows exemplary pressure response curves 800 for the point sets120/121, 120/121, 120/121 in FIGS. 1 through 3 respectively. The curve820 corresponds to the pressure at touch 120, 220, 320 in FIGS. 1through 3 respectively and the curve 821 corresponds to the pressure attouch 121, 221, 321 in FIGS. 1 through 3 respectively. The curves 820,821 illustrate an exemplary pattern in which the pressure at one touchincreases as the other decreases. The second graph 850 in FIG. 8 showsthe curve 855 of the difference between the pressure of each touch inthe touch point sets 120/121, 220/321, 320/321 in FIGS. 1 through 3respectively. In this example, the difference between the two is uses.But the processor may use other mathematical combinations of thepressure data from the two or more points including ratios andmultiples. The pressure response curves 820, 821 illustrated in FIG. 8are only exemplary, and the disclosed systems may accommodate otherpressure response curves such as those 920, 921 shown in FIG. 9.

The process may further be programmed to provide adjustment informationto a coupled device based on the gesture, pattern, and/or pressureresponse. For example, as the user varies the pressure at two or moretouch points in a see-saw gesture, the processor may adjust UI elements(such as brightness, magnification) accordingly. Additionally, theprocessor may cause the UI to scroll, fast forward, or reverse based onthe based on the gesture, pattern, and/or pressure response.Additionally, using multiple touch points, the sensor array andprocessor may be configured to determine the relative orientation offingers as well as the relative pressure allowing multi-dimensionalinput (e.g., scrolling in two dimensions). FIG. 10 illustrates anexample 1000 in which a sensor array 1010 provides multi-dimensionalinput based on the relative location of touches and relative pressure ofthe touches. For example, the processor could be programmed to controlhorizontal scrolling based on the difference in pressure between points1020 and 1030 or between points 1021 and 1031. Alternatively, theprocessor could be programmed to control horizontal scrolling based onsome combination of the difference in pressure between points 1020 and1030 and between points 1021 and 1031. Similarly, the processor could beprogrammed to control vertical scrolling based on the difference inpressure between points 1020 and 1021 or between points 1030 and 1031.Alternatively, the processor could be programmed to control verticalscrolling based on some combination of the difference in pressurebetween points 1020 and 1021 and between points 1030 and 1031.

In another embodiment, the processor is programmed to determine thecontinuous pressure change at one or more point on the sensor array andto cause the UI to provide visual feedback based on the continuouspressure at the one or more point. For example, a button on a touchscreen may shrink or grow in proportion to the force applied.Alternatively, the process may be programmed to cause the UI to provideaudible and/or haptic feedback in proportion to the force applied.

In another embodiment, the processor is programmed to determine if thepressure applied at one or more points exceeds a threshold and thendetermine if the pressure at the one or more points falls below a secondthreshold and to cause the UI to provide feedback (e.g., visual, audio,and/or haptic) after the pressure at the one or more points falls belowthe second threshold. The magnitude (e.g., brightness, duration, size,amplitude) of the feedback may be based on the magnitude of the pressure(e.g., the amount the pressure exceeded the threshold, how quickly thepressure exceeded the threshold, and/or how quickly the pressure fellbelow the second threshold). In one example, the UI may provide a“springy” response that resembles a bounce back after the pressure attouch is released. In another example, the UI may open an item if thepressure on an icon corresponding to the item exceeds a threshold andmay “de-commit” or stop opening the item if the pressure is releasedwithin or exceed a specified time or release rate. In one example, ahard push and release quickly may open the item, but a slow releasewould cause the item to slide back into closed state. In anotherembodiment, the feedback is a graphic effect where the image on thescreen gets distorted when the user touches it (e.g., elastic-likedeformation). Additionally, a touch may cast a virtual shadow in the UI.

With the continuous pressure sensing systems and methods disclosedherein, feedback may be provided proportionally to the amount of forceapplied to the sensor array. Accordingly, in one embodiment, theprocessor is programmed to cause the UI to provide feedback proportionalto the pressure at the one or more touch points. For example, the UI maycause objects to start opening and continue opening with more pressurethereby providing visual feedback. And the UI could provide feedback(e.g., visual, audio, haptic) once the object is open.

In another embodiment, the system uses a combination of (1) the touchpattern (the size, shape, and number) of the one or more points incontact with the sensor array instantaneously and/or over time togetherwith (2) the pressure at the one or more touch points instantaneouslyand/or over time. The combination of these inputs is used to provideinput to the processor and UI of a coupled device. FIG. 11 illustratesexamples of how the touch pattern may change over time. At one instant,the touch pattern 1100 on a sensor array of a thumb 1101, index finger1102, middle finger 1103, ring finger 1104, and pinky finger 1105 isshown. At another instant in time, the user may pick up the pinky finger1105 and ring finger 1104 leaving a touch pattern 1110 distinct from thefirst. Similarly, the user may roll his or her fingers causing moresurface of the fingers to be in contact with the sensor array creating atouch pattern 1120 with more elongated contact surfaces 1121, 1122,1123. In some embodiments, the system is adapted to use the touchpattern of the palm of a hand as an input. For example, an increase inthe force of a user's palm is an input that could be used alone and/orin combination with other touch patterns to initiate a command orfunction.

For example, one finger may apply a heavier force and another finger hasa lighter force. The finger with the heavier force may be assigned to anaction to hold an object and the finger with the lighter force may beassigned to move the background around the held object. In oneapplication for instance, a user may press hard on a photo to select itand then use a light touch with another finger to move it around a mapor gallery. In another example, the system uses the combination of forcepattern at one or more locations with the changes in force patterns todetermine motion such as rotation and/or the number of touch points(e.g., two fingers or three fingers).

FIG. 12 illustrates the pressure at the one or more touch pointsinstantaneously and over time. In the example shown in FIG. 12, thethree curves 1201, 1202, 1203 correspond to the thumb 1101, index finger1102, and middle finger 1103 touch points in FIG. 11. In FIG. 12, thepressure at time t₀ on each of the thumb 1101, index finger 1102, andmiddle finger 1103 touch points is approximately equal. Thereafter, thepressure on the thumb 1101 increases (as shown in curve 1201) while thepressure on the other two finger remains fairly constant. Accordingly,at time t₁, the pressure on the thumb has increased but the pressure onthe other two fingers is about the same as at t₀. Thereafter, thepressure on the index finger 1102 increases and at time t₂, the pressureon the thumb 1101 and index finger 1102 is increased but the pressure onthe middle finger is approximately the same as at t₀. Thereafter, thepressure on the thumb 1101 decreases and the pressure on the indexfinger 1102 and middle finger 1103 increase. At time t₃, the pressure atall three points is elevated over time t0, but the pressure on the thumb1101 is decreasing. As shown, the pressures on the three fingers riseand fall in sequence corresponding to a rolling or wave patter from thethumb 1101 to the index finger 1102 to the middle finger 1102. Thesystems disclosed herein may use a pressure patter such as thatillustrated in FIG. 12 to provide input to the processor and UI of acoupled device. And the systems disclosed herein may use the combinationof (1) the touch pattern (the size, shape, and number) of the one ormore points in contact with the sensor array instantaneously and/or overtime together with (2) the pressure at the one or more touch pointsinstantaneously and/or over time to provide input to the processor andUI of a coupled device. And the systems disclosed herein may beconfigured to provide feedback (e.g., visual, audio, haptic) based onthe combination of (1) the touch pattern (the size, shape, and number)of the one or more points in contact with the sensor arrayinstantaneously and/or over time together with (2) the pressure at theone or more touch points instantaneously.

For example, the processor and UI may be configured to show a number ofwindows based on the pressure, number, and/or pattern of touches.Different fingers, body parts, styli, and other objects with varyinglevels of force can be used to create different actions in the UI.Various different input touches may include: knocking on a surface likea door, licking it, elbowing it, breathing on it, rolling a hand acrossit, laying a hand on it, sculpting it like clay, spiraling withprogressive force, rubbing it by setting fingertips then moving arm,finger tapping from pinky to pointer, touching with knuckle(s), touchingwith elbow(s), touching with a phalanx (or phalanges), scratching (smallarea with high force). In one embodiment, the system uses the pressurepattern to determine the user has laid the side of the user's face onthe large display (as if the user is laying down to sleep). The systemmay use that input to cause an associated action such as putting thedevice to sleep or otherwise changing its power state.

In one example shown in FIG. 13, a user may rap on a large displaydevice 1310 with one or more knuckles (e.g., like knocking on a door).The one or more knuckles make contact 1320, 1321, 1322, 1323, 1324 withthe touch sensor array. A knock is high force tap. The system uses thehigh force characteristics to distinguish knocking from other touches.In one example, the knocking gesture may be used to control a largedisplay mounted in a car, for example with a navigation application. Onesuch gesture could re-center a navigation screen with one or moreknuckles or take the user to list of directions or let the user lookahead (e.g., at the next 15 minutes of driving) by zoomingappropriately.

Additionally, a tapping or pounding gesture could be used for othercommands such as those used in unusual situations. For example, thesegestures could be used to dial 911 or dispatch emergency response (e.g.,dial 911 if the user knocks on the screen three times within a giventime period or if the user knocks or pounds on the device repeatedly).

Another example is a kneading pattern of multiple fingers pushing in andout with translating horizontally or vertically on the sensor array. InFIG. 16, hands 1601 are placed on the sensor array 1600 to create akneading pattern from the left hand to the right hand. Similarly, a wavepattern of four fingers touching the sensor array and using rollingamount of pressure without translating horizontally or vertically on thesensor array. Further, pressure with two fingers may correspond to onecommand but pressing harder on one or the other may correspond to adifferent command. In another example, the combination of (1) the touchpattern (the size, shape, and number) of the one or more points incontact with the sensor array instantaneously and/or over time togetherwith (2) the pressure at the one or more touch points instantaneouslymay be used to activate different layers used in programs or visuallayers in the UI.

Additional examples gestures include moving a thumb, finger, or otherobject in a circle to undo, redo and/or zoom in and out. Such gesturesenable a user to do as much as possible on device with one or bothhands. Further, as described above, patterns with force can be used foradditional gestures such as (1) with little force, a regular touch isapplied and (2) with pressure, the user's gestures like circlescrolling, or swiping are caused to do different things. Also, a deepclick may be linked to scroll and/or pan. The system may also detect thetorque in finger motion and use that as a gesture input. In one example,a user's wavering motion in the finger is used to modulate the response(e.g., waver up and down (north to south) to change scroll direction).And in one example, while an item is selected, a swirling motion withone or more points in contact with the device may be used to delete theselected item.

In some or all of these examples, multiple users can use the sensorarray simultaneously. In one example, the sensor array can be used toidentify individual users reject contacts from unintended users orobjects.

Additionally, the disclosed systems are used to recreate existing deviceinteractions. For instance, the user may place his or her hand on thesensor array as if holding a mouse. The hand movements on the sensor maybe used to move the cursor. A tap from the index finger may correspondto a left click, and a tap from the middle finger may correspond to aright click. Multiple fingers together could move the scroll wheel.

Recreating existing devices can be accomplished with or without objectsthat recreate the shape of the existing device. The variable impedancetouch sensor arrays can be located on the surface of the object, insidethe object or on the surface/inside another object. For instance, arubber hemisphere is moved on top of a variable impedance touch sensorarray and the forces applied to the object are transmitted to the sensorarray.

Additionally, one or more of the surfaces of a device may be used as apointing or typing input for the device (e.g., when both hands areplaced on the display, the device enters a typing mode). For example,FIG. 14 illustrates a touch surface 1410 that may enter a typing modewhen a pattern corresponding to two hands 1411, 1412 are placed on thetouch surface 1410. Additionally, the gesture input signals generated(including pattern and pressure) may be combined with signals from othersensors in the device (e.g., motion sensors, acoustic sensors) todetermine corresponding gestures (e.g., a hard grasp combined with rapidfalling may indicate a drop or a hard grasp with rapid shaking maycorrespond to a specific control signal). In some embodiments, when thesystem enters a typing mode, a virtual keyboard is displayed on a screencommunicatively coupled to the touch surface 1410. The coupled displaymay be integral with the touch surface 1410 (e.g., a touch display) orit may be external to the touch surface 1410. In other examples,gestures can be used to bring up the keyboard, including bringing downall the fingers to provide a starting location or rapping against thesensor array. In another example, flicking the fingers on the sensorarray can be used to dismiss the keyboard.

In one example, the touch surface is the surface of a laptop (A-, B-, orC-top surface). In an example seen in FIG. 17 in which the touch surface1700 is integrated in the C-top of a laptop 1703, placing fingers 1701in a touch pattern (e.g., a standard typing hand arrangement) on thesurface causes the surface to display a virtual keyboard. The surfacemay also change to other interfaces based on the touch pattern on thetouch surface (touching the touch surface with a hand in a shape usedfor a physical computer mouse would cause a virtual mouse or cursor tobe displayed or holding a hand in a writing position would cause avirtual pen or stylus to be displayed). Alternatively, the laptop maydisplay the virtual keyboard on the B-top display integrated in thelaptop. The sensor array can be in one or more areas on the laptop. Thevirtual keyboard may provide visual feedback by illuminating each key asit is touched the virtual keyboard.

For all applications, feedback can be added to the sensor array. Thefeedback can be haptics, optical, auditory and/or other method toprovide feedback for the inputs applied to the sensor array.

In one embodiment, a touch surface system is adapted to determinepatterns of objects placed on the touch surface. For example, a touchsurface on a countertop may determine the touch pattern of objectsplaced on the countertop. In one example, the touch pattern caused bycertain type of plate or bowl causes a scale to appear on an integratedor external display showing the corresponding weight. Similarly, thetouch surface system may be adapted to determine the touch pattern ofother objects with pre-determined shapes, for example, circles or starsor squares. The touch surface system is adapted to determine the touchpattern created by the shapes under their own weight when placed on thetouch surface and/or when additional pressure is applied to the shapes.The system is adapted to cause a specific function or control based onthe touch pattern corresponding to each shape. The system may be adaptedto respond to touch patterns of other objects such as beverage bottlesor cans. And as the pressure pattern changes over time, the system maybe adapted to change control signals. In some embodiments, specialobjects or tools are provided to the user. In other embodiments, thetouch pattern of objects is programmed into or learned by the system.Touch patterns can be intentionally designed or part of an existingobject. In that way, users may program function(s) to one or more objector combination of objects.

The touch surface may be adapted to respond to touch patternsdifferently based on the area of the touch surface in which the touchpattern is located. For example, areas around an identified object onthe surface may get special interactive meanings. For example, if a userputs down a pencil and touches on the left side of the touch surface,color controls are activated. And if the user puts down the pencil andtouches the right side of the touch surface, dimensional controls areactivated. In FIG. 18, a pencil 1800 is in contact with the sensorarray. A finger 1801 is placed to the left of the pencil and a windowappears 1802. As with other embodiments, the touch surface may beintegrated with a display such that the controls are displayed at aspecific location on the display (e.g., at the point the user touchesafter putting down the pencil).

FIG. 15 illustrates an example in which a touch surface 1510 is used tocontrol a remote display 1500. The touch surface 1510 may also comprisea display of its own. As discussed above, one example is that of thetouch surface 1510 being the C-top surface of a laptop and the display1500 being the B-top display of a laptop. In one embodiment, the touchsurface 1510 has specific controls (e.g., a keyboard, piano) in whichthe system is context aware. When the user is editing a text field, thesystem should display appropriate keyboard on the display 1500 ordisplay integrated into the touch surface 1510. When a user is in apiano or music application, the system displays piano keys on thedisplay 1500 or display integrated into the touch surface 1510. When theuser is in a video editing app, the system displays a specific controlfor video editing on the display 1500 or display integrated into thetouch surface 1510. Additionally, users can create their own customcontrol panels for each application.

In some embodiments, user interaction with the touch surface 1510 isused to open applications and/or unlock applications. For example,gesture of turning, pushing and/or pulling (like turning a knob to opena door) corresponds to opening or closing an application. Additionally,touch force patterns can be used to lock and/or unlock devices and/orapplications.

Moreover, the interpolated variable impedance touch sensor arrays may beused to detect pressure patterns that may damage the device. In FIG. 19athe sensor array 1900 is bent 1901 in such a way that would causedamage. In FIG. 19b the sensor array 1903 has a sharp point of a knife1904 applied to the sensor array. Using this input, the system may alarmif a user acts in a way that would damage the device. And the system maydetect when the device is bent and/or under strain.

The gestures described can be used for multiple controls as describedabove and including (but not limited to) switching applications, goingto a home screen, applying custom presets, going back, going forward,zooming, operating the camera (e.g., using side pressure input to makeselfies and pictures easier), changing volume, and/or changingbrightness.

FIGS. 20 and 21 illustrate visual feedback possible with the system.FIG. 20 illustrates continuous response and user feedback (2001, 2002)and discontinuous response and user feedback (2003, 2004, 2005). The twographs on the left-hand side of FIG. 20 (2001, 2002) illustratecontinuous response and user feedback based on the continuous responsefrom near zero to high forces. The upper left-hand side graph 2001 showsa linear continuous response with respect to force applied. And thelower left-hand side graph 2002 shows a non-linear continuous responsewith respect to force applied.

In other embodiments, it is preferred not to have a continuous responseand user feedback based on the continuous response from near zero tohigh forces. The right-hand side graphs in FIG. 20 (2003, 2004, 2005)illustrate discontinuous response and user feedback. In the upperright-hand side graph 2003 in FIG. 20, the discontinuous response startsout at or near zero and provides no response until a threshold force isreached. Once the threshold force is reached, response is providedrelative to the force applied within a force detection band. In thisillustration, the response is linear with applied force, but otherfunctional relationships (e.g., polynomial, exponential, logarithmic)are also applicable. At the upper end of the force detection band (at anupper threshold), no additional response is provided with additionalapplied force. Accordingly, the upper right-hand side graph illustratesa force detection band embodiment.

The middle right-hand side graph 2004 in FIG. 20 illustrates adiscontinuous response in which the discontinuous response starts out ator near zero and provides no response until a threshold force isreached. Once the threshold force is reached, response is providedrelative to the force applied within a force detection band. In thisillustration, the response is linear with applied force, but otherfunctional relationships (e.g., polynomial, exponential, logarithmic)are also applicable.

The lower right-hand side graph 2005 in FIG. 20 illustrates adiscontinuous response in which the discontinuous response is providedrelative to the force applied within a force detection band. In thisillustration, the response is linear with applied force, but otherfunctional relationships (e.g., polynomial, exponential, logarithmic)are also applicable. Once a threshold force is reached, response isprovided relative to the force applied within a force detection band.

FIG. 21 illustrates examples of feedback magnitude increasingcontinuously with force. The system can provide continuous appearingfeedback from a few grams of force to a high level of force (e.g.maximum voluntary contraction strength of a user), and the appearance ofcontinuous motion may be defined as meeting the criteria of creating aPhi phenomenon or Beta movement illusion. Further, the ability toprovide feedback from nearly zero grams force increases thediscoverability of interaction, as users can use their intuition aboutthe physical world and visual cues as they explore the interface todiscover force-based interactions. The system may include feedback forhover, press, and/or drag as well as for amount of force with tilt,protrusion/depth, shadow, distortion, fill, transparency, peek, andviewport motion (pan, zoom, tilt, perspective).

The three rows of illustrations in FIG. 21 (2101, 2102, 2103)demonstrate graphical user interface changes with increases in appliedforce shown in the chart 2104 at the bottom of FIG. 21 plotting feedbackmagnitude as a function of applied force. For example, in the top row ofillustrations 2101 in FIG. 21, as the applied force increases, thequadrilateral shape is distorted relative to the applied force. As theapplied force increases, the amount of distortion in the quadrilateralshape also increases relative to the applied force.

In the middle row of illustrations 2102 in FIG. 21, a change in shadowof a square shape is shown relative to the applied force. In thisexample, as the applied force increases, the amount of shadow (forexample, illustrating the relative virtual depth of the square shape orvirtual distance out of plane of the screen) decreases or is enhanced(as if the shape is getting closer to the surface on which the shadow iscast). Alternatively, the amount of shadow may increase with an increasein applied force depending on the application.

In the third row of row of illustrations 2103 in FIG. 21, a change insize or magnification a group of shapes (a circle, a triangle, and asquare) is shown relative to the applied force. As the applied forceincreases, the size (or magnification) of the shapes increases relativeto the applied force.

FIG. 22 illustrates an exemplary method 2200 of using an interpolatedvariable impedance sensor array for gesture recognition. This method2200 includes detecting two or more touches at a first time at thesensor panels 2210 and determining that the two or more touches at thefirst time are arranged in a pattern corresponding to a predeterminedgesture 2220. The method also includes determining a relative pressurebetween the two or more touches 2230, associating the gesture with auser interface (UI) element based on the relative pressure between thetwo or more touches 2240, and providing the confirming input to the UIelement based on the relative pressure between the two or more touches2250.

In the present specification, the term “or” is intended to mean aninclusive “or” rather than an exclusive “or.” That is, unless specifiedotherwise, or clear from context, “X employs A or B” is intended to meanany of the natural inclusive permutations. That is, if X employs A; Xemploys B; or X employs both A and B, then “X employs A or B” issatisfied under any of the foregoing instances. Moreover, articles “a”and “an” as used in this specification and annexed drawings shouldgenerally be construed to mean “one or more” unless specified otherwiseor clear from context to be directed to a singular form.

In addition, the terms “example” and “such as” are utilized herein tomean serving as an instance or illustration. Any embodiment or designdescribed herein as an “example” or referred to in connection with a“such as” clause is not necessarily to be construed as preferred oradvantageous over other embodiments or designs. Rather, use of the terms“example” or “such as” is intended to present concepts in a concretefashion. The terms “first,” “second,” “third,” and so forth, as used inthe claims and description, unless otherwise clear by context, is forclarity only and does not necessarily indicate or imply any order intime.

What has been described above includes examples of one or moreembodiments of the disclosure. It is, of course, not possible todescribe every conceivable combination of components or methodologiesfor purposes of describing these examples, and it can be recognized thatmany further combinations and permutations of the present embodimentsare possible. Accordingly, the embodiments disclosed and/or claimedherein are intended to embrace all such alterations, modifications andvariations that fall within the spirit and scope of the detaileddescription and the appended claims. Furthermore, to the extent that theterm “includes” is used in either the detailed description or theclaims, such term is intended to be inclusive in a manner similar to theterm “comprising” as “comprising” is interpreted when employed as atransitional word in a claim.

What is claimed is:
 1. A system for detecting a continuous pressurecurve for a touch on a display device comprising: a plurality ofphysical variable impedance array (VIA) columns connected by interlinkedimpedance columns; a plurality of physical VIA rows connected byinterlinked impedance rows; a plurality of column drive sourcesconnected to the interlinked impedance columns and to the plurality ofphysical VIA columns through the interlinked impedance columns; aplurality of row sense sinks connected to the interlinked impedance rowsand to the plurality of physical VIA rows through the interlinkedimpedance rows; and a processor configured to interpolate the continuouspressure curve in the physical VIA columns and physical VIA rows from anelectrical signal from the plurality of column drive sources sensed atthe plurality of row sense sinks.
 2. The system of claim 1 wherein theprocessor is configured to detect two or more touches at a first time,determine that the two or more touches at the first time are arranged ina pattern corresponding to a predetermined gesture, determine a relativepressure between the two or more touches from the electrical signal fromthe plurality of column drive sources sensed at the plurality of rowsense sinks, and associate the continuous pressure curve with a userinterface (UI) element, the UI element accepting an adjustment inputbased on the relative pressure between the two or more touches, andprovide a confirming input to the UI element based on the relativepressure between the two or more touches.
 3. The system of claim 1wherein the processor is configured to resize a user interface (UI)element proportionally to the continuous pressure curve.
 4. The systemof claim 1 wherein the processor is configured to determine that thetouch on the display device is a high force tap corresponding to aknuckle tap from the continuous pressure curve.
 5. The system of claim 1wherein the processor is configured to determine that the touch on thedisplay device is a kneading pattern of multiple fingers pushing in andout with translating horizontally or vertically on the sensor array fromthe continuous pressure curve.
 6. The system of claim 1 wherein theprocessor is configured to determine that the touch on the displaydevice is a pressure pattern that can damage the device from thecontinuous pressure curve.
 7. The system of claim 6 wherein theprocessor is configured to cause an alert if it determines that thetouch on the display device is a pressure pattern that can damage thedevice.
 8. The system of claim 1 wherein the processor is configured todetect two or more touches at a first time and determine a relativepressure between the two or more touches from the electrical signal fromthe plurality of column drive sources sensed at the plurality of rowsense sinks.
 9. The system of claim 1 wherein the processor isconfigured to determine a pressure response from the electrical signalfrom the plurality of column drive sources sensed at the plurality ofrow sense sinks.
 10. The system of claim 9 wherein the processor isconfigured to provide adjustment information to a coupled device basedon the gesture location and pressure response.
 11. The system of claim 1wherein the processor is configured to determine a relative orientationof a plurality of fingers from the electrical signal from the pluralityof column drive sources sensed at the plurality of row sense sinks and arelative pressure applied by the plurality of fingers from theelectrical signal from the plurality of column drive sources sensed atthe plurality of row sense sinks.
 12. The system of claim 1 wherein theprocessor is configured to determine a continuous pressure change at oneor more points on the sensor array from the electrical signal from theplurality of column drive sources sensed at the plurality of row sensesinks and to cause a user interface (UI) element to provide visualfeedback based on the continuous pressure at the one or more points. 13.The system of claim 1 wherein the processor is configured to determine apattern of touches of one or more points in contact with the sensorpanel instantaneously or over time and to determine a pressure at theone or more points in contact with the sensor panel instantaneously orover time.
 14. A system for detecting a continuous pressure curve for atouch on a display device comprising: a variable impedance array (VIA),an array column driver, an array row sensor, and a processor; whereinthe VIA includes interlinked impedance columns coupled to the arraycolumn driver and interlinked impedance rows coupled to the array rowsensor; wherein the array column driver is configured to select theinterlinked impedance columns based on a column switching register andelectrically drive the interlinked impedance columns using a columndriving source; wherein the VIA conveys current from the driveninterlinked impedance columns to the interlinked impedance columns whichare sensed by the array row sensor; wherein the array row sensor selectsthe interlinked impedance rows and electrically senses a state of theinterlinked impedance rows based on a row switching register; andwherein the processor interpolates a location of the touch from thestate of the interlinked impedance rows sensed by array row sensor. 15.The system of claim 14 wherein the processor is configured to detect twoor more touches at a first time at the sensor panel and determine arelative pressure between the two or more touches from the electricalsignal from the state of the interlinked impedance rows sensed by arrayrow sensor.
 16. The system of claim 14 wherein the processor isconfigured to determine a touch pattern of one or more points in contactwith the sensor array, a pressure response pattern at the one or moretouch points over time from the state of the interlinked impedance rowssensed by array row sensor, and a gesture pattern corresponding to thetouch pattern and the pressure response pattern.
 17. The system of claim14 wherein the processor is configured to determine a pressure responsefrom the state of the interlinked impedance rows sensed by array rowsensor.
 18. The system of claim 14 wherein the processor is configuredto determine a relative orientation of a plurality of fingers from thestate of the interlinked impedance rows sensed by array row sensor and arelative pressure applied by the plurality of fingers from the state ofthe interlinked impedance rows sensed by array row sensor.
 19. Thesystem of claim 14 wherein the processor is configured to determine apattern of touches of one or more points in contact with the sensorpanel instantaneously or over time and to determine a pressure at theone or more points in contact with the sensor panel instantaneously orover time.
 20. A method for receiving a gesture formed on or about twoor more sensor panels on a plurality of faces of a device comprising:detecting two or more touches at a first time at the sensor panels;determining that the two or more touches at the first time are arrangedin a pattern corresponding to a predetermined gesture; determining arelative pressure between the two or more touches; associating thegesture with a user interface (UI) element based on the relativepressure between the two or more touches; and providing the confirminginput to the UI element based on the relative pressure between the twoor more touches.